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(54) PICTURE PROCESSING METHOD AND PICTURE PROCESSOR 



m (57)Abstract: 
PROBLEM TO BE SOLVED: To provide a picture processor bringing no 
hindrance to displaying even when a bus bandwidth temporarily runs short, and a 
method therefor. 

SOLUTION: The picture processor holds a signal, which indicates that a write 
address has become larger than a read address, in an overflow detecting circuit 
35 in a picture fetching device 6, and creates a signal that can be released by a 
horizontal or vertical synchronizing signal obtained from a camera signal 
processing circuit 31. Moreover, write and read controllers 33, 34 for FiFo 
memory stop read or write operation to the FiFo memory and also initialize the 
memory by the held overflow signal. 
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CLAIMS 
[Claim(s)] 

[Claim 1] With an address-generation means to generate the 2nd address for 
reading this image data from the 1st address and this memory for writing image 
data in memory, and said 1st and 2nd addresses A taking-in means to control 
writing and read-out of image data in said memory, and to incorporate this image 
data, A decision means to judge whether said memory is in an overflow condition 
based on the comparison result of said 1st address and 2nd address, An 
interruption means to interrupt taking in of said image data based on the 
aforementioned taking-in means when said memory is judged to be in an 
overflow condition, The image processing system characterized by having a 
restart means to resume taking-in processing of this image data based on the 
aforementioned taking-in means, according to the predetermined synchronizing 
signal used for taking in of said image data. 

[Claim 2] It is the image processing system according to claim 1 characterized by 



to have further a generation means generate the predetermined condition signal 
which shows the overflow condition when it is judged that said memory is in an 
overflow condition with said decision means, for said interruption means to 
initialize the content of said memory while resetting said address-generation 
means with said condition signal, and to interrupt taking in of said image data 
based on the aforementioned taking-in means. 

[Claim 3] Said restart means is an image processing system according to claim 1 
characterized by performing the restart of taking in of said image data using the 
next Horizontal Synchronizing signal at the time of the incorporation concerning 
said interruption. 

[Claim 4] Said restart means is an image processing system according to claim 1 
characterized by performing the restart of taking in of said image data using the 
next Vertical Synchronizing signal at the time of the incorporation concerning 
said interruption. 

[Claim 5] The image processing system according to claim 1 characterized by 
having further the display means which carries out the display output of the 
image data by which reading appearance was carried out from said memory 
according to said 2nd address. 

[Claim 6] With the address-generation process which generates the 2nd address 
for reading this image data from the 1st address and this memory for writing 
image data in memory, and said 1st and 2nd addresses The taking-in process 
which controls writing and read-out of image data in said memory, and 
incorporates this image data, The decision process which judges whether said 
memory is in an overflow condition based on the comparison result of said 1st 
address and 2nd address, The interruption process which interrupts taking in of 
said image data based on the aforementioned taking-in process when said 
memory is judged to be in an overflow condition, The image-processing 
approach characterized by having the restart process which resumes taking-in 
processing of this image data based on the aforementioned taking-in process 
according to the predetermined synchronizing signal used for taking in of said 



image data. 

[Claim 7] It is the image-processing approach according to claim 6 characterized 
by to have further the generation process which generates the predetermined 
condition signal which shows the overflow condition when it is judged that said 
memory is in an overflow condition according to said decision process, for said 
interruption process to initialize the content of said memory while resetting said 
address-generation process with said condition signal, and to interrupt taking in 
of said image data based on the aforementioned taking-in process. 
[Claim 8] Said restart process is the image-processing approach according to 
claim 6 characterized by performing the restart of taking in of said image data 
using the next Horizontal Synchronizing signal at the time of the incorporation 
concerning said interruption. 

[Claim 9] Said restart process is the image-processing approach according to 
claim 6 characterized by performing the restart of taking in of said image data 
using the next Vertical Synchronizing signal at the time of the incorporation 
concerning said interruption. 

[Claim 10] The image-processing approach according to claim 6 characterized by 
having further the display process which carries out the display output of the 
image data by which reading appearance was carried out from said memory 
according to said 2nd address. 

[Claim 11] The storage which stores the control program for making a computer 
perform an approach according to claim 6 to 10. 

[Translation done.] 
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2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention has the function which incorporates a 
dynamic image in the real time, and displays, for example, relates to an image 
processing system and the image-processing approaches, such as a pocket 
mold still picture recording device. 
[0002] 

[Description of the Prior Art] A dynamic image is incorporated, it has the function 
which displays, for example, the still picture recording device of a pocket mold is 
conventionally known for the real time. Drawing 5 is drawing showing an example 
of the common still picture recording device in which real-time dynamic-image 
incorporation and a display are possible. In drawing 5 , an external device 
controller for the CPU memory by which the central control unit (CPU) with which 
501 controls this whole equipment, and 502 were connected to the CPU bus 504, 
and 503 to record the recorded still picture data on an external storage element 
like a flash card, and 505 are bridge circuits which connect the CPU bus 504 and 
the image bus 510. 

[0003] Moreover, the image memory circuit which records temporarily the 
dynamic image with which the display with which image incorporation equipment 
for 506 to incorporate a dynamic image and 507 can display a dynamic image, 
and 508 were incorporated with image incorporation equipment 506, and 509 use 
the captured image as a still picture, and are compression / 
compression/expanding circuit to elongate. 

[0004] Drawing 6 shows the more detailed block diagram of image incorporation 
equipment 506. In this drawing, the analog from the area sensor by which 131 is 



not illustrated or the camera digital disposal circuit which carries out camera 
signal processing of the digitized image data, and 132 are the Fifo memory for 
absorbing the difference between the clock rate used by camera signal 
processing in the camera digital disposal circuit 131, and the clock rate used by 
image bus 510. 

[0005] It is based on the clock rate which 133 is initialized by the reset signal 
from the outside, and is used by the camera digital disposal circuit 131. The 
write-in address controller which generates the address which writes image data 
in the Fifo memory 132, and 134 The read-out address controller which is 
initialized by the reset signal from the outside and generates the read-out 
address based on the clock rate of an image data bus, and 135 Read with the 
write-in address and a bus interface is received from the value of the address. 
The data transfer demand to an image memory is generated, or it is the overflow 
detector which detects overflow and outputs an overflow signal, and, specifically, 
consists of two magnitude comparators. Moreover, 136 is a bus interface which 
performs the right demand of a bus to an image bus based on the transfer 
request from the overflow detector 135. 

[0006] Then, actuation of the still picture recording device in which the 
conventional real-time dynamic-image incorporation and a display are possible is 
explained. The image data incorporated from the image incorporation equipment 
506 of drawing 5 is temporarily accumulated in the image memory 508. Moreover, 
the OSD data for an onscreen display are also stored in an image memory 508. 
[0007] On the other hand, an indicating equipment 507 performs a screen 
overlay using the OSD data for an onscreen display stored on the image memory 
508 at the same time it reads image data from an image memory 508 and 
performs the display. 
[0008] 

[Problem(s) to be Solved by the Invention] However, it is necessary to set up 
highly to the extent that it can be satisfied with it of a bandwidth required for an 
OSD data transfer about the pass band width of face for transmitting image data 



from the need of rewriting OSD data according to a situation, while it is fully 
satisfied with the still picture recording apparatus in which the above-mentioned 
conventional real-time animation incorporation and a display are possible of a 
data transfer rate. 

[0009] Therefore, it is necessary to set up the clock rate of a bus highly or to set 
up the data bit width of face of a bus widely, and as a result, it leads to buildup of 
power consumption, or enlargement of equipment, and the problem of following 
difficulty on carrying conventional equipment as it is is in the small pocket device 
based on still picture record. 

[0010] The place which this invention was made in view of the above-mentioned 
technical problem, and is made into the object is offering the image processing 
system and the image-processing approach it is made not to cause trouble to a 
display, also when the situation that a presserfoot and other devices access 
incorporation of a dynamic image and the minimum bandwidth which is needed 
for a display into an image bus, and pass band width of face runs short 
temporarily generates the data transfer rate of a bus. 
[0011] 

[Means for Solving the Problem] The image processing system by this invention 
for attaining the above-mentioned object With an address-generation means to 
generate the 2nd address for reading this image data from the 1st address and 
this memory for writing image data in memory, and said 1st and 2nd addresses A 
taking-in means to control writing and read-out of image data in said memory, 
and to incorporate this image data, A decision means to judge whether said 
memory is in an overflow condition based on the comparison result of said 1st 
address and 2nd address, An interruption means to interrupt taking in of said 
image data based on the aforementioned taking-in means when said memory is 
judged to be in an overflow condition, The image processing system 
characterized by having a restart means to resume taking-in processing of this 
image data based on the aforementioned taking-in means, according to the 
predetermined synchronizing signal used for taking in of said image data. 



[0012] Moreover, the image-processing approach by other modes of this 
invention for attaining the above-mentioned object With the address-generation 
process which generates the 2nd address for reading this image data from the 
1st address and this memory for writing image data in memory, and said 1st and 
2nd addresses The taking-in process which controls writing and read-out of 
image data in said memory, and incorporates this image data, The decision 
process which judges whether said memory is in an overflow condition based on 
the comparison result of said 1st address and 2nd address, When said memory 
is judged to be in an overflow condition, according to the predetermined 
synchronizing signal used for the interruption process which interrupts taking in 
of said image data based on the aforementioned taking-in process, and taking in 
of said image data, it has the restart process which resumes taking-in processing 
of this image data based on the aforementioned taking-in process. 
[0013] 

[Embodiment of the Invention] Hereafter, the gestalt of operation concerning this 
invention is explained to a detail with reference to an accompanying drawing. 
Drawing 1 is the block diagram using the dynamic-image data transfer unit 
concerning the gestalt of this operation showing the outline configuration of the 
still picture recording apparatus whose animation can be displayed. In this 
drawing, an external device controller for the memory by which the central control 
unit (the following, CPU) with which 1 controls this whole equipment, and 2 were 
connected to the CPU bus 4, and 3 to record the recorded still picture data on 
external storage elements (for example, flash card etc.), and 5 are bridge circuits 
which connect the CPU bus 4 and the image bus 10. 
[0014] Moreover, the image memory which records temporarily the dynamic 
image with which the display with which the image incorporation equipment with 
which 6 incorporates a dynamic image, and 7 can display a dynamic image, and 
8 were incorporated with image incorporation equipment 6, and 9 use the 
captured image as a still picture, and are compression / compression/expanding 
circuit to elongate. 



[0015] Drawing 7 shows arrangement of the image data on the memory 8 at this 
time, and image data is written in a field 122. in addition, level [ in a memory 
configuration ] in drawing 7 -- 1024 -- vertical -- it considers as 1024 pixels and 
level in the present area sensor output -- 640 -- vertical -- it has illustrated as 480 
pixels, moreover, it is the viewing area with which a field 121 is the whole 
memory, a field 122 is in confusion now, and image data on display is 
remembered to be, and level [ with this operation gestalt ] in drawing 7 , -- 640 
pixels is vertical -- it is shown as 480 pixels. 

[0016] Furthermore, the OSD field which stores the OSD data with which the 
screen overlay of the field 123 of drawing 7 is carried out to a display screen at 
the time of a display, and a field 124 are compression fields which store the 
image data to which compression/expanding circuit 9 performs compression or 
expanding processing. 

[0017] Drawing 2 is the block diagram showing roughly the internal configuration 
of the image incorporation equipment 6 of drawing 1 . In the image incorporation 
equipment 6 shown in this drawing, the camera digital disposal circuit which 
carries out signal processing of the analog output which was digitized from the 
area sensor by which 31 is not illustrated, and which is not outputted or digitized, 
and 32 are the FIFO (Fifo) circuits for outputting it to the image bus (image data 
bus) 10, after making the digitized camera signal which is outputted from the 
camera digital disposal circuit 31 into a certain amount of amount of signals. 
[0018] The write-in address controller which generates the write-in address for 33 
to write data in Fifo32 synchronizing with the digital signal outputted from the 
camera digital disposal circuit 31 , and 34 are read-out address controllers which 
generate the address for reading data from Fifo32 to the timing which 
synchronized with the image bus 10, when the right of a bus of the image bus 10 
is able to be taken. 

[0019] moreover, 35 is an overflow detector which detects whether the condition 
(that is, condition of causing overflow) of carrying out reading appearance to the 
write-in address of the write-in address controller 33, and the address controller 



34 carrying out reading appearance to it, comparing the address with it, and the 
write-in address carrying out reading appearance, and passing the address has 
occurred. 

[0020] Drawing 3 is the block diagram showing the example of the overflow 
detector 35 of drawing 2 . In this drawing, 41 is a NAND circuit where an RS flip 
flop and 42 output '1' when the address of a comparator and 45 is "0" as for a 
subtraction circuit and 43. In this detector, "WA-RA" is calculated in the 
subtraction circuit 42 to the read-out address RA from the read-out address 
controller 34 of drawing 2 (two or more bits) as well as the write-in address WA 
(two or more bits) from the write-in address controller 33 of drawing 2 . The write- 
in address WA and the read-out address RA are inputted also into NAND circuit 
45 at the same time they are inputted into the subtraction circuit 42. NAND circuit 
45 is set up so that T may be outputted, when each inputted address is "0" (all 
bits are 0), and the output of the NAND circuit for WA addresses is connected to 
S input of RS flip flop 41 at R input of the RS flip flop with the same output of the 
NAND circuit for RA addresses. By this, when WA address returns to "0" 
exceeding the upper limit of a counter, an RS flip flop output (CA) is set to T, 
and it is made to subtract considering the output of this RS flip flop as an 
extension bit of WA address of the subtraction circuit 42 (that is, when the upper 
limit of a counter is 63, 64+WA-RA will be performed in the subtraction circuit). 
On the other hand, when the read-out address RA returns to "0" exceeding the 
upper limit of a counter, the output (CA) of the RS flip flop set previously is reset 
by '0', and performs the usual subtraction (WA-RA). 
[0021] The above-mentioned result of an operation is compared with a 
predetermined value (in drawing 3 , it is the value shown by FixD and is 1 time of 
the number of transactions in the image bus 1 0) by the comparator 43, and when 
WA-RA is larger than this number of transactions, the output Q of a comparator 
43, i.e., the request signal of a bus transaction, (REQ) is set to T. This signal is 
transmitted to the bus interface 36 of drawing 2 , and a bus interface 36 starts 
actuation that a bus transaction should be generated. 



[0022] On the other hand, BR output of the subtraction circuit 42 is set to T 
noting that this detector has generated overflow, when the result of an operation 
in the subtraction circuit 42 becomes more than the number of stages of FIFO. 
Consequently, the output of RS flip flop 41 connected to this output is set to T, 
and this signal (OVR) is eventually transmitted to the interruption controller of 
CPU as a signal which shows "overflow." 

[0023] the signal which took the OR (OR) of this simultaneously the signal (OVR) 
which shows overflow, and the RESET signal (active High) supplied from the 
outside carries out reading appearance to the write-in address controller 33 of 
drawing 2 , and is supplied as a reset signal (RST) of the address controller 34. 
[0024] As mentioned above, the signal (OVR) which shows "overflow" is set by 
BR signal from the subtraction circuit 42, and is reset by the Horizontal 
Synchronizing signal pulse HD (active High) supplied from the RESET signal 
(active High) from the outside, and the camera digital disposal circuit 31 of 
drawing 2 . for this reason, even when overflow of Fifo32 occurs, with the signal 
"HD pulse" by which the signal of the next line from the camera digital disposal 
circuit 31 begins to be supplied, reading appearance is carried out to the write-in 
address controller 33, the reset signal of the address controller 34 is reset (that is, 
discharge), reading appearance also of the write-in address controller 33 is 
carried out, and the address controller 34 can also resume the usual transfer 
operation from a new line. 

[0025] Drawing 4 A and drawing 4 B are timing charts which show the actuation 
mentioned above according to time series. In this drawing, the video clock with 
which VCLK is used by camera signal processing, and WA The write-in address 
controller 33 the write-in address signal and BCLK which are used for control of 
Fifo32 The bus clock and RA which are used by image bus 10 The read-out 
address and Diff which the read-out address controller 34 of Fifo32 outputs The 
A-B signal which shows the result (WA-RA) of having read from the write-in 
address and having subtracted the address, and OVR The signal and HD which 
show overflow of Fifo32 The Horizontal Synchronizing signal and Valid which are 



obtained from the camera digital disposal circuit 31 The signal which shows that 
the data obtained from the camera digital disposal circuit 31 are effective, and 
REQ are signals which only the data which can be transmitted to Fifo32 are 
stored and require generating of a bus transaction from a bus interface. 
[0026] In addition, drawing 4 A and drawing 4 B have shown the number of 
stages of 8 (a transaction is operated 8 beat) and Fifo32 for the fixed value for 
generating a REQ signal as 64. 

[0027] Hereafter, with reference to drawing 4 A and drawing 4 B, the actuation 
and return actuation at the time of overflow of Fifo32 are explained. It read [ in / 
based on this result / here, the data of a considerable amount shall already be 
stored in Fifo32, overflow of Fifo32 occurs to the timing t1 in drawing, and an 
OVR signal is set to T, and / timing t2 ] with the clock effective [ of a degree ], 
Address RA wrote in to timing t3 again, Address WA was reset, respectively, and 
each has returned to "0." 

[0028] Henceforth, since an OVR signal is held T, both WA and RA maintain "0." 
Then, an OVR signal is reset by '0' when HD signal supplied from the camera 
digital disposal circuit 31 is set to T (timing t4). And "1" every increment of the 
write-in address WA is carried out as effective pixel data are supplied from the 
camera digital disposal circuit 31 . 

[0029] Since the read-out address RA cannot be transmitted until a certain 
amount of [ on the other hand ] data to Fifo32 are stored, it becomes since that 
an increment begins to be carried out actually acquires the right of a bus after 
timing t5 from which the REQ signal which the difference signal Diff of the 
address mentioned above reaches eight transactions, and requires generating of 
a bus transaction of a bus interface 36 is set to T. 

[0030] Thus, in the dynamic-image data transfer unit concerning the gestalt of 
this operation, even when the situation that a presser foot and other devices 
access incorporation of a dynamic image and the minimum bandwidth for which it 
is needed at a display into an image bus, and pass band width of face runs short 
temporarily generates the data transfer rate of a bus, in order to make it not 



cause trouble to a display, the bus data transfer by the side of a display is set up 
more firmly than the bus transfer by the side of incorporation. 
[0031] Simultaneously, it is an incorporation side and bus transfer rates ran short, 
when the condition that the data written in memory become unusual occurs, 
while stopping data transfer promptly, the data in the Fifo memory for a transfer 
were cleared, and the configuration which resumes incorporation actuation of a 
dynamic image is taken using the next synchronizing signal at the time of 
incorporation. 

[0032] Therefore, the signal which shows that the write-in address read to the 
overflow detector 35 in image incorporation equipment 6, and it became larger 
than the address is held, and it has RS flip-flop circuit for creating the signal 
which can be canceled with the horizontal or Vertical Synchronizing signal which 
can acquire this held signal from the camera digital disposal circuit 31. Moreover, 
the writing and read-out address controller to FiFo memory have a halt and the 
function to initialize for the writing to FiFo memory, or read-out actuation with the 
overflow signal held in this way. 

[0033] As explained above, even when Fifo causes overflow according to the 
gestalt of this operation, without the ability taking the right of a bus, since 
mutually related high data are held in time in front of one by stopping the transfer 
processing to the memory of image data with an overflow signal, the data on an 
image memory are effective in not causing trouble to a display. 
[0034] Even when putting in another way and the situation that the capacity of a 
bus is temporarily insufficient occurs, pressing down the transfer rate of a bus to 
necessary minimum, it is a dynamic image incorporation-side, and the right of a 
bus cannot be taken, but the deficiency in performance of a bus can be improved 
by considering as the configuration whose image incorporation equipment will not 
give a bus demand to the flash when Fifo caused overflow temporarily. 
[0035] Moreover, it is effective in minimizing the part which failed in the image 
data transfer by rebooting image data transfer processing using the Horizontal 
Synchronizing signal acquired from a camera digital disposal circuit, and the 



sense of incongruity on a screen being made to min in an indicating-equipment 
side to those who use for an indicative data the video data incorporated last time, 
and see, since writing in memory can also prevent the data in which it made a 
mistake by overflow of Fifo. 

[0036] With the gestalt of the operation which carried out [modification] ****, 
although the Horizontal Synchronizing signal from a camera digital disposal 
circuit is used for the return from overflow of Fifo, it is not limited to this, for 
example, the return from overflow of Fifo may be performed using a vertical 
signal. In this case, when performing bus access (for example, rewriting of OSD 
data) for which the device connected to image data buses other than a camera 
digital disposal circuit and a display circuit needs a certain amount of data 
transfer period, the bus access from a camera digital disposal circuit can be 
restricted over 1 vertical period. 

[0037] Therefore, transfer processing of the device connected to image data 
buses other than a camera digital disposal circuit and a display circuit can be 
ended early, and the sense of incongruity given to a display decreases as a 
result. In addition, the equipment configuration in this case is easily realizable by 
replacing with Vertical Synchronizing signal VD Horizontal Synchronizing signal 
HD explained with the gestalt of the above-mentioned implementation. 
[0038] 

[Other operation gestalten] In addition, even if it applies this invention to the 
system which consists of two or more devices (for example, a host computer, an 
interface device, a reader, a printer, etc.), it may be applied to the equipments 
(for example, a copying machine, facsimile apparatus, etc.) which consist of one 
device. 

[0039] Moreover, it cannot be overemphasized that the object of this invention 
supplies the storage (or record medium) which recorded the program code of the 
software which realizes the function of the operation gestalt mentioned above to 
a system or equipment, the computer (or CPU and MPU) of the system or 
equipment reads the program code stored in the storage, and it is attained also 



by performing. 

[0040] In this case, the storage with which the program code itself by which 
reading appearance was carried out from the storage will realize the function of 
the operation gestalt mentioned above, and it memorized that program code will 
constitute this invention. As a storage for supplying a program code, a floppy disk, 
a hard disk, an optical disk, a magneto-optic disk, CD-ROM, CD-R, a magnetic 
tape, the memory card of a non-volatile, ROM, etc. can be used, for example. 
[0041] Moreover, it cannot be overemphasized that it is contained also when the 
function of the operation gestalt which the operating system (OS) which is 
working on a computer performed a part or all of actual processing, and the 
function of the operation gestalt mentioned above by performing the program 
code which the computer read is not only realized, but it mentioned above by the 
processing based on directions of the program code is realized. 
[0042] Furthermore, after the program code by which reading appearance was 
carried out from a storage is written in the memory with which the functional 
expansion unit connected to the functional add-in board inserted in a computer or 
a computer is equipped, it is needless to say in being contained also when the 
function of the operation gestalt which performed a part or all of processing that 
the CPU with which the functional add-in board and functional expansion unit are 
equipped based on directions of the program code is actual, and mentioned 
above by the processing is realized. 
[0043] 

[Effect of the Invention] As explained above, since mutually related high data are 
held in time in front of one by a memory apparatus's causing overflow, without 
the ability taking the right of a bus, and stopping the transfer processing to the 
memory apparatus of image data with an overflow signal even when the situation 
that the capacity of a bus is temporarily insufficient occurs, according to this 
invention, the data on a memory apparatus do not cause trouble to a display. 
[0044] Moreover, according to this invention, by rebooting image data transfer 
processing using the Horizontal Synchronizing signal or Vertical Synchronizing 



signal acquired from the incorporation equipment of data, the part which failed in 
the image data transfer can be minimized, and the sense of incongruity on the 
display screen can be held down to min. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram using the dynamic-image data transfer unit 
concerning the gestalt of this operation showing the outline configuration of the 
still picture recording apparatus whose animation can be displayed. 
[Drawing 2] It is the block diagram showing roughly the internal configuration of 
the image incorporation equipment concerning the gestalt of operation. 
[Drawing 3] It is the block diagram showing the example of the overflow detector 
concerning the gestalt of operation. 

[Drawing 4 A] It is the timing chart which shows actuation of an overflow detector 
according to time series. 

[Drawing 4 B] It is the timing chart which shows actuation of an overflow detector 
according to time series. 

[Drawing 5] It is the block diagram showing an example of the conventional still 



picture recording apparatus. 

[Drawing 6] It is the detailed block diagram of conventional image incorporation 
equipment. 

[Drawing 7] It is drawing showing arrangement of the image data on memory. 
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[Drawing 4 B] 
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[Translation done.] 



